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ABSTRACT 

This technical mesorandui presents an outline o£ how 
to apply psycholinguistic and intellective concepts in order to 
enhance the readability and comprehensibility of written materials. 
Guidelines for making the reader's task easier are provided, and some 
readability measvxement procedures are also discussed. The contents 
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morphemes, sentence voice problems, negativity problems, 
self-embedding, depth, complements, and branching; "Helping the 
Reader's Intelligence to Work Easily," which looks at deenphasizing 
vocabulary diversity, seeing generalizations, cutting down 
unnecessary details in figures and diagrams, repeating facts for the 
reader, organizing the material, and avoiding abbreviations: and 
"Measuring Readability," which discusses the use test, the 
comprehension test, rating by experts, the cloze procedure, element 
counting techniques, and more details on readability measures. 
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In t rodur t i on 

The purpose of these T^chn I qu^s for leaking \llritten lAa- 
terlal Niore Readab I ? Compr^hcn $ I b U is to improve the capabil- 
ity of Air Force training manuals, texts, and other written materi- 
als to transfer information to the Intended readers. 

The person who will profit the most (if the suggestions wo lay 
down here are followed) is the person who must read, comprehend, 
and apply the written information which you write. This manual was 
prepared to help technical writers and others who write training texts 
and other student materials to write them so that readt rs will have 
an easier time. 

Basically, any situation which requires reading comprehen- 
sion also requires learning. That is, a reading situation is also a 
learning situation. The reader may not be required to learn the read- 
ing passage or book totally, but he is required to remember the con- 
cepts, facts, relationships, and implications presented in the reading. 
According to Gagne (1965), learning is a change in human capacity 
not dependent upon maturation or growth. "The kind of change called • 
learning exhibits itself as a change in behavior, and the inference 
of learning is made by comparing what behavior was made possible 
before the individual was placed in a 'learning situation' and what be- 
havior can be exhibited after such treatment. The change may be, 
and often is, an increased capability for some type of performance" 
[p. 5J . The definition given by Gagn^ corresponds precisely to a de- 
scription of an individual prior to and after he reads textual material. 

Until now, people who were interested in the question of how 
to make written materials more readable concerned themselves with 
analyzing materials that were already written, in terms of frequency 
of common words, word length, sentence length, etc. (e.g., i'Teschi, 
1943; Dale & Chall, 194B). These approaches have not proven to be 
entirely adequate for making materials more readable. We will make- 
no use of them here. Neither are we interested in teaching what has been 
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\\\^^''^ ''>\l''';S ^^^^^^^^ writing" (e.g., Flesch, 1043. 

IM46. HMM; (.ro.vK. I.eary. 1035). We arc, however, interested in 
applying the findings from modern scientific research relative to how 
certain kinds of written materials impose a heavy load on a reader's 
miml. On the basis of these findings, we can tell a writer how to 
avoid placing a heavy mental load on hus reader and thus, at the same 
time, make his written material more understandable. 

In the pastyear. Applied Psychological Services, under con- 
tract to the Air Force Human liesources Laboratory, has conducted 
research into what maKes written material more understandable 
V\e studied this problem from two approaches. One approach looked 
into the question of how, human intelligence works during reading--if 
we know how it worki^ we can manipulate written material so that it 
allows the intelligence to work as well as possible and thus make the 
material easier to understand. The second approach looked into the 
question of how some written materials place a heavy mental load on 
a reader. If we can answer this question, we can tell writers how 
to avoid using m.aterials that impose such heavy mental loads on a 
reader, and thus make the material more readable. 

It is from the findings of these two research approaches that 
we will try to give you some tips on how to write n.aterial that is 
more readable. The end result will be a written text from which 
the reader learns more from the same amount of time investment on 
his part. 



In much of the older research on readability, we find the sug- 
gestion that, to make reading matter more understandable, we should 
avoid long words. One of the most important findings which came out 
of the research on the mental load imposed on the reader by various 
types of textual material was that the length of the words themselves 
does not matter too much. What matters is how many things called 
•■morphrmcs" make up the word. A morpheme may be a whole word 
itself, or^it may bo a "little word" inside a bigger word. Let us ex- 
plain this'briefly. 'I'he word "rose" is a single morpheme--it is an in 
dividual unit of meaning or learning. The word "means" something all 
by itself. .\ow, look at the word "unhappiness. " It too is a word, but 
inside it are three "little words, " "un"--which means not, "happi" 
--which refers to an (>motional state, and "ness"--whic-h refers to 
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the fact that something is in a particular state, condiuun, or qualit> . 
The whole word '^unhappiness*' means that someone is not in the state 
of being happy. It contains three morphemes packed into one v/ord. 

The research demonstrated that when a piece of reading ma*- 
terlal contained words that consisted of a lot of these morphemes 
(In little words), it was much harder to understand than was a sim- 
ilar piece of reading matter that contained fewer morphemes. This 
tells us that when we write » we should choose our word: so that we 
say what we want to say with words that contain as few morphemes 
as possible. Take the following sentence: *'The boy was sick be- 
cause of his unhappiness. " Most readers would understand it more 
easily ii we wrote: '*The boy is sick because he is not happy, 

Assume that you are writing a manual for a mechanic's job* 
Rather than use the phrase "Disassemble the interconnecting link- 
age*' you should write "Take apart the interconnecting linkage, 
Here, we have employed fewer morphemes. 

As a second example, take the following paragraph on the 
mouth-to-mouth method of artificial respiration (which we might 
better call "breathing for another person"): 

In this method you breathe air into the victim's lungs 
with your own mouth. Since you consume only part of 
the oxygen out of the air you inhale, the air you 
breathe into the victim's lungs contains enough oxygen 
to revive him (from AF student text 3AQR30030), 

Most students would learn more easily from the text, if we changed 
it to read: 

In this method you breathe air into the victim's lungs 
with your own mouth. Since you use only part of the 
oxygen out of the air which you breathe in, the air you 
breathe into the victim's lungs has enough oxygen to 
bring him back. 

Just by making these few changes, we have increased the para- 
graph's readability/comprehensibility without altering the content. 
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As a writer, your job is to give other people the know-how 
that you hcive; you car> do this best by usirifi words with only a few 
morphemes. The thoughts can be big. but the morphemes should 
be lew. 



S««ii I «'« V «• Vo I V »« Pro h I era J* 

Our research has also told us srmething about how the "voice" 
used in a sentence affects readability/ comprehensibility. The voice 
used m writing a sentence tells the reader about the relationship that 
exists between the subject and the verb of a sentence ^- what is happen- 
ing ana who or what is doing it. The research results indicate that 
the voice the writer chooses may help or hinder a read erU- understand- 
ing of what he is trying to say. Let us look at three comir.on voices 
used m writing I::ngUsh--the active, the passive, and the pa.isive-neg- 
ative. Here is an active sentence: "They found th-i boy sleeping on 
the floor. Here is a passive sentence: "The boy was found sleeping 
on the floor. Here is a passive negative sentence: "The boy was not 
found sleeping on the floor. " — — — 

Most other researchers found that active sentences are easier 
to understand than passive sentences, and passive sentences are easi- 
er to understand than passive -negative sentences. We found no differ- 
ences in difficulty between active and passive sentences, but we did 
find that passive-negative sentences are harder to understand than 
are either active or passive sentences. Furthermore, we found that 
the people we tested who were lower in reading ability had more trou- 
ble with passive -negative sentences than did people of bett'-r reading 
ability. ^ 

What do those findings indicate about how to choose sentences 
when you write? Primarily, they tell us that you should avoid using 
the passive-negative voice whenever possible. For example, the sen- 
tence ''The capacitor was not found to have a proper resistor in series 
with it" could probably be i^derstood easier if it read: "He did not find 
the capacitor to have the proper resistor in series with it. " 



ERIC 



4 



It seems reasonable, also, to stick to the active voice, rather 
than to use the passive, whenever possible. This especially holds if 
it is possible that the reader would confuse the roles played by the sub- 
ject and the object of the sentence. The active voice is less ambiguous. 
It avoids thought transpositions and reformulations. It is also a good 
idea to change a sentence like "The horse was seen by him to be running 
around the track" to read "He saw the horse running around the track. " 
When you do this, you not only change the voice of the sentence but you 
"personalize" the sentence--you insert "He" in place of the impersonal 
"The. " This helps the reader to understand the sentence better. 

^e^tttivity Problems 

We have already noted that passive-negative sentences are 
harder to comprehend than either active or passive sentences. It 
seems that possibly the word "not" in these kinds of sentences is 
what often confuses the reader. Asa matter of fact, any word or 
morpheme that denotes negativity will do the same. Accordingly, 
words with prefixes like "un, " as in "unwise" or "dis, " as in "dis- 
assemble, " or "mis" as in " mis represent" are more difficult to un- 
derstand than positive words. 

It seems that some "educated" people intentionally do this by 
talking liko the professor in the cartoon. They hope to impress oth- 
ers with their pretentious "erudition" by "snowing" their audience. 



ERJ.C 



5 



BEST COPY mum. 




So, when you write, try to say things in as positive a way 
•».s possible. Kather than write "Do not disassemble the apparatus" 
write "Leave th(? apparatus assembled. " In general, avoid the "un, " 
"dis, " "<le. "mis" prefixes, as well as any other denoting negativ- 
ity, unless they are absolutely essential for emphasis. 



St^ I t'-Eiithetld i 11^ 

One other finding from our research on mental load and read- 
ability of written materials was the effect of "center-embedding" a 
sentence. A sentence is center-cm^'idded when a clause is added be- 
tween the subject and t.he predicate of the sentence. Here is a center- 
embedded sentence: * The president, hav.ng no intention of yielding to 
the repeated demands of the citiiiens, was forcing them to revolt . " 
The underlined words show the .-iubject and the predicate of the sen- 
tence's main clause. All of the other cU>vses are "embedded" between 
the subject- -president -- and the predicate- - was forcing. 

Separating the subject and the predicate confuses the reader 
in regard to who is doing what. If you ever find that you have written 
an embedded sentence, here is how you can "de-embed" it. Do not * 
separate the subject and the object with one or more phrases. Accord- 
i^^gly* the sentence in the prior example would be written as: "The 
president was forcing the citizens to revolt because he had no intention 
of yielding to their repeated demands. " When you do this, you put the 
actor and the act Itself in the sentence close together. This results in 
less confusion for your reader- -you place a "lighter" mental load on 
him. 

Here are some examples of self-embedded sentences; they are 
center-embedded from one to five clauses. Head them anci you will 
see how to recognize if your own sentences are embedded: 



a. The victim's family's lawyer demanded that the 
ransom be returned, (self -embedded by one clause) 

b. The girl, having no heart, was allowing him to suf- 
fer, (self-embedded by two clauses) 

c. The student, showing no promise of meeting the high 
expectations of his teachers, was forcing them to re- 
consider, (self-embedded by three clauses) 

d. The president, having no intention of yielding to the 
repeated demands of the citizens, was forcing them 
to revolt, (self -embedded by four clauses) 

e. The dragon, giving no evidence of surrendering under 
the numerous attacks of the knights who charged at him 
with a loud clash of swords, was forcing them to re- 
treat, (self -embedded by five clauses) 

• 

Depths Cumpl lament .s, and Branching 

Some researchers have suggested that depth, complements, 
and branching are important in determining materials^ readability. 
Sentence ''depth" (the degree to which words are ''buried'' within a 
sentence) has been suggested to be of some importance in terms of 
readability. Here is a sentence of very low depth: 

This car has x^'our tires. 

Here is a sentence that has a pretty high depth: 

The new car which the neighbors bought and which has 
already been delivered, is a gift for their son who is 
graduating from college this semester. 

The first sentence should be much easier to read and to understand 
than is the second sentence. Here is a way to make the second sen- 
tence lower in '*(lepth'* and thus more readable: 

Tho new car has already been delivered. 
It was brought by the neighbors as a gift for their 
son. He is qraduating from college this semester. 
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By breaking a long sentence like this into a number of shorte 
sentences, we can reduce "depth^' and thus increase readability. 




Some investigators have found that if a complement like the 
word "when" is deleted (left out) from a sentence, the sentence is 
harder to read. For example, the sentence "The man the dog bit 
died" is harder to understand than the sentence" The man whom the 
dog bit died. " So, when you are writing a sentence like "John be- 
lieved the girl was a fool" you can make it more readable if it were 
to read "John believed that the girl was a fool. " When you do this, 
you help the reader to understand the true "message" of the sentence 



A right branching sentence is a sentence in which successive 
clauses are added to the right of the main clause as in this sentence 
"The umpire called a balk that the southpaw pitcher hit that the coach 
replaced . " A left branching sentence is one in which successive 
clauses are added to the left of the main clause as in this sentence 
"The electricity powered toe chomping rock throwing lawn mower 
ran over its own cord. " (The underlined words show the added 
Glauses. ) Most people have a hard time reading and understanding 
the right branching sentence but not the left branching sentence. You 
should avoid using right branching. 



Helping the Reader's Intelligence to Work Easily 

If reading materials are such that the reader must work very 
hard to understand what is being said, the reader will have less energy 
left for learning the concepts and the facts that are presented. 

Oeemphasize Vocabulary Diversity 

Don't assume that the reader has a diverse vocabulary. Find 
the words you want and stick to them. Repeat them in your writing. 
Even if your reader has a diverse vocabulary, word repetition will 
make the text more comprehensible. Do not worry about finding 
synonyms for words --just use the same words over and over. The 
children's rhyme "One little piggy went to market, one little piggy 
stayed home" takes advantage of this. The rhyme, in its original 
form, is less mentally burdening than an alternate such as "One little 
piggy went to market, one diminuitive porkster stayed home. " 

Similarly, jargon and prestige terms are often substituted for 
good old fashioned English. These terms are mcluded to show that 
the writer belongs to the proper "in group. " Some writers keep a 
thesaurus on their desks in order that they can demonstrate their 
flexibility in word choice. Don't fall into this trap. 

Ad-i-ad-o-cho-kin-e-sis 

Is a term that will bolster my thesis 

That • tis idle to seek 

Such precision in Greek 
When confusion it only increases 

(from English & English, 1958) 
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LinkioK Things Up for the Reader 

• 



Don't force your reader to make his own guess as to what 
goes with what or to form his own conclusions. Tank related thoughts 
and state the conclusion when necessary. For example, if you were 
writing instructions for a base delivery man, you would not assume 
that he knows what to deliver and where to deliver it. If you want 
beer to go to the NCO club and milk to the commissary, you would 
not write "Deliver the beer and the milk to the NCO club and the 
commissary. That is, don't assume that the reader knows that the 
beer goes to the NCO club, but that the milk goes to the commissary. 
Tell him. ^ 




Similarly, don't make any assumptions about what the reader 
knows or about the conclusions he will draw. Especially, don't as- 
sume that he should be able to "figure out for himself" things which 
logically follow from the information that you give him. If you write 
"The towns of Brown Mills and Pemberton are south of the base, " 
don't assume that he'll figure out for himself that he has to go south 
to get to them. Tell him. This is easily accomplished through the 
use of such words as? therefore, accordingly, thus, it follows that, 
that is, consequently, and in other words. 

Here is the way to tell if you have linked things up properly 
for your reader. Divide the number of sentences in your material by 
the number of incomplete hook-ups. Here is an example: "The firemen 
and the physicians rushed into the burning house. They pulled out 
their syringes and their hatchets. " Who pulled out what? Maybe it 
is not obvious to some people that the physicians pulled out the sy- 
ringes and the firemen the hatchets --he re the writer failed to hook-up 
the two, so there are two incomplete linkages. There are two sen- 
tences and two incomplete linkages--2/2 = 100%. Writing which shows 
any evidence of an incomplete linkage should be reviewed and rewrit- 
ten so as to remove the incomplete linkage. This organizes the thoughts 
and ideas for the reader and makes the learning easier. 

Seeing Gen eral i /ation.s 

Related to the problem of drawing conclusions from written ma- 
terial is the problem' of generalization. Often the writer will state a 
rule or procedure and anticipate that the reader will be able to gener- 
alize to the many situations to which the rule will apply. Similarly, 
the writer may state a conclusion and anticipate that the reader will 
be able to draw the implications from the conclusion. Such general- 
ization and Implication drawing is very difficult for some people. It 
increases the mental burden imposed on the reader and slows the rate 
of learning. 

l^or example, a writer of electronics principles material 
might write "The voltige in a circuit is equal to the product of the 
intensity of the current and the resistance of the circuit. " Such a 
sentence would leave the reader to figure out the generalizations and 
implications which can be drav/n from the statement. On the other. 
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hand, if the writer had performed the required implication drawing 
for the reader, more learning would be likely to occur. For exam- 
ple, the writer could elaborate by the use of such sentences as: 
"Therefore, voltage can be increased by decreasing resistance? or 
by increasing current intensity, " "Accordingly, to obtain the inten- 
sity of the current, one would divide the voltage by the resistance, " 
"On the other hand, decreasing either intensity or resistance decreases 
voltage, " etc. 

Here, again, the provision of the examples relieves the reader 
of the mental work involved in filling in the required implications and 
generalizatioris. Required order is provided and false generalizations 
are prevented. The full meaning of the principle is provided for the 
reader. Accordingly, the "so what?" feeling is eliminated, and per- 
haps most important, time is saved. 




Show the implications 
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^:uuinp Down lnneces«ary DetaiU Presented 
in fipureji and Diafframs 



Where ideas are to be presented for learning by means of 
a figure, such as a map., a diagram of a machine, or a schematic 
of an electronics circuit, do not clutter your reader's mind with a 
log of unimportant details. Draw only what is absolutely necessary 
foi:' him to learn the specific point. Otherwise, the reader may miss 
th ? forest because of the trees. For example, if he has the job of 
soldering a 100 microfarad capacitor to a one-hundred and fifty 
thousand ohm resistor, draw this: 



not this: 



150K 
100 mf 



160K 



150K 



100 mf 



■Wv- 

lOOK 
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Repeating Fads for your Reader 

Be "redundant" in your writing — repeat the facts you want to 
get across to your reader. Try repeating them by writing them in a 
slightly different way. Example: "After you have tightened the three 
wing-bolts, attach the antenna. Tightening the three wing-bolts before 
antenna attachment simplifies later steps. If you fail to tighten the 
three wing-bolts before antenna attachment, the result will be. . . " 

The way to determine just how redundant your material is would 
be simply to count the number of fact repetitions you have made. In 
the previous example, it is 3. 00. If th« faqt repetition number is low 
relative to the number of facts presented th« comprehensibility of your 
text will probably suffer. 

If you find that your writing has made frequent use of such words 
and phrases as: to repeat, in effect, accordingly, consequently, to reit- 
erate, and in other words, your writing has to some extent achieved 
this memory unburdening goal. Remember that your goal is to trans- 
fer information to the reader — not to make him work hard. 
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Organ ixtii|{ your .Material 



Try to provide memory aids for your reader. Give the read- 
er's memory a helping hand. For example, to help beginners learn 
the musical staff, musicians introduced the memory aid (mnemonic) 
FACE. Some acronyms also qualify as memory aids: 



RADAR - Radio and Ranging 



Another example of a memory aid is found in Psalm 145. The first 
letter of each line forms the alphabet in sequence. Likewise, the 
jingle "Thirty days hath September. . . " is a valid example of a mem- 
ory aid. A figure or picture which shows a process described in the 
text also qualifies as a memory aid. Here, we refer to figures which 
truly provide a memory assist and not to those which merely beautify. 

If the writer places a burden on the reader's memory, the ef- 
fort which the reader must exert increases. The motivation of the 
reader, who must now work harder to comprehend the writing, may 
decrease. If motivation decreases, learning decreases. According- 
ly, the rule to remember is that the memory demands on the reader 
should be assisted or reduced wherever possible. 



Avoid Abbreviations 

(Xir research has shown us that the excessive use of abbrevi- 
ations and contrived words is an especially disruptive influence on 
reading comprehension. The great writer George Orwell knew this, 
and in his novel IVInftc^n Eighty-Four he tells us of his apprecia- 
tion of the fact that the excessive use of abbreviation, acronyms, 
and the like can even be used to paralize our ability to think clearly. 
Here is an example from Orwell: 
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Scattered about London there were just three 
other buildings of similar appearance and size* So 
completely did they dwarf the surrounding architec- 
ture that from the roof of Victory Mansions you could 
see all four of them simultaneously. They were the 
homes of the four Ministries between which the entire 
apparatus of government was divided: the Ministry of 
Truth, which concerned itself with news, entertainment, 
education, and the fine arts; the Ministry of Peace, 
which concerned itself with war, the Ministry of Love, 
which maintained law and order; and the Ministry of 
Plenty, which was responsible for economic affairs. 
Their names, in Newspeak: Minitrue, Minipax, Miniluv , 
and Miniplenty. 

The Ministry of Love was the really frightning 
one. There were no windows in it at all. (Emphasis 
ours> p»6) 



As Orwell later notes, the use of this kind of language is • • 
designed not to extend but to diminish the range of thought. . • " (p. 304). 
A writer's ! b is to extend his reader's knowledge; to do so, avoid 
writing which employs excessive or unnecessary abbreviations and ac- 
ronyms. 



Here is a way of determining if you have too many abbrevia- 



tions in your writing. Count the number of words in your sentence and 
then count the number of abbreviations and/ or contrived words in it. 
Put the former in the denominator and the latter in the numerator of a 
ratio. The smaller the numerator, relative to the denominator, the 
easier your material is. 

If you follow the suggestion outlined above, you will make your 
writing easier for your reader to understand. 
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CHAPTER II 



MEASURING READABILITY 



We have attempted to suggest some ways of writing that 
make material more readable and comprehensible. This chapter 
describes some methods for determining how readable already 
written material is. 

There are a number of methods which can be used to meas- 
ure the readability of the text you write. The'Air Force Human Re- 
sources Laboratory is also performing research which will provide 
new and improved measures of readability/ comprehensibility. These 
new methods will be fully extended so that the comprehensibility of 
any text can be calculated through digital computer methods. Addi- 
tionally, the new methods will be diagnostic. That is, they will tell 
a technical writer how to improve his writing as well as how com- 
prehensible a given piece of material is. The older methods, which 
are described below, do not possess this feature. 

The Use Test 

The use test is appropriate for testing manuals and other 
procedural guides. In the use test, persons having a background 
which is similar to the background of the eventual users of textual 
materials are asKed to employ the written materials in "real -life" 
situations. The users are observed, their errors are noted, and a 
score is derived. This score is then used as a measure of the ma- 
terial's ability to get its message across to the reader. 

To use this procedure, you need: (a) a group of persons who 
are representative of the users of your manual, and (2) a set of the 
real -life situations that your manual is to be used with. 

The group of persons is asked to use the manual to perform 
the tasks. Errors are noted, scores are derived, and the written 
materials are revised so as to minimize the future occurrence of 
these errors. The sample of users may also be questioned about 
any areas of confusion introduced by the text. Comparison of scores 
of groups on the test "before" and "after" revision indicates the ex- 
tent of improvement brought about by the revision. The advantage 
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of the use test is that it possesses high face validity. The disad- 
vantages of the use test involve its high cost and the fact that in 
this prbcedure the final score confounds technical inability to per- 
form with unreadability of materials.. 

The Comprehension Test 

The comprehension test approach parallels that of the use 
test and represents a written examination which is administered to 
a group of people (sample) which is representative of the ultimate 
readers of the material. First, the group is asked to read the ma- 
terial. Then the test is administered. You can also administer this 
test as an "open book" test. If you want to use this method, you 
will need: (1) a group of would-be manual users, and (2) a prepar- 
ed test which is based on the specific messages you want to get 
across. 

After test administration and scoring, the textual materials 
are revised in accordance with areas of low comprehensibility, as 
indicated by poor scores on the test. 

The advantage of this method of testing readability is that 
it is relatively inexpensive to apply. Its disadvantages involve the 
fact that the writing may be acceptable but the test may be poor. 
Also, unless comprehension tests of equivalent difficulty can be 
constructed, the possibility of making comparisons across differ- 
ent manuals is ruled out. 

Rating by Experts 

In the rating by experts technique, a number of experts on 
the subject matter about which you have written are asked to ex- 
amine and read your material and to estimate its understandabil- 
ity in comparison with other materials or on some other basis. 

If you wish to use this approach, you will need: (1) a group 
of people who are considered to be experts on the subject matter 
under consideration, and (2) a group of materials against which the 
experts can compare a representative sample of your materials. 
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The materials should cover the range of "acceptable" through unac- 
ceptable. " The experts are asked to state the comparison text 
which is closest to the text under consideration. Text portions re- 
ceiving low readability/ comprehensibility ratings are then rewritten. 
'I'he disadvantages of this techiiique concern the problems that can 
arise in the selection of the experts and in the criterion material, 
as well ab in generalization from the expert opinion to the user popu- 
lation. 



The CI o«e Procedure 



The "cloze" procedure yields a measure of the "commonality 
between the total language system of the author and the reader" [ Os- 
good, 1959, p. 81]. Here, words are left out of a passage of written 
material, and the reader fills these gaps with words that make the 
most sense to him. The degree to which you, as the writer, use words 
that the reader expects and understands will determine the ease with 
which he can successfully fill in the correct words. 

To use the cloze procedure, the gaps are made by leaving 
out certain words of the text; the cloze score indicates the extent 
to which a reader can reproduce the original "sense" of the materi- 
al after it has been "broken up. " High cloze scores show that good 
reproduction of the original "sense" has been made, and a low cloze 
score tells us that the readability of a passage has suffered as the 
result of leaving out the words. 

In order to employ this procedure, you need: (1) short (250 
word) selections from your written material, and (2) a systematic 
leaving out of certain words from the passages (for example, every 
fifth word). The broken-up copy of the passages is presented to a 
group who are representative of the ultimate readers; this group is 
asked to fill in the missing words. The result is a cloze score (aver- 
age number of correct fill ins). The higher this score, the more 
readable your writing is. As with the other methods, sections with 
low scores are rewritten and, if necesoary, retested. The cloze 
procedure possesses a number of advantages over other methods of 
measuring readability of technical manuals. These advantages include 
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the facts that: cloze does not penalize the technical publication as 
do Meach and similar counting procedures, cloze seems to meas-, 
ure desirable redundancy in the prose, and finally, the method ma^- 
be administered by persons who have little special training in test' 
development and administration. The disadvantages of the cloze 
method is that, because norms are unavailable, one doesn't know 
what the most desirable close score level is. 

Klomem CuuntiiiK Teohnlques 

Some of the most, common and popular methods of determin- 
mg the readability of written materials are based on element count- 
ing techniques. Among these methods are Flesch counts and the 
Dale-Chall technique. These techniques are based on such factors 
as the length of the sentences In the materials and on the familiarity 
of the words used in the writing. The use of these element counting 
procedures involves: (1) getting together a representative collection 
of your written materials, (2) making the appropriate sentence length, 
word length, etc. , counts, and (3) entering a set of tables which ref- 
erence the score obtained by the textual materials under considera- 
tion to standard materials. 

There is, however, a problem with these techniques when we 
apply them to technical material (material which you, as an Air Force 
technical writer, will most probably be involved with). Technical ter- 
minology, although uncommon by general standards, is common to 
people working within a particular specialty. Thus, technical materi- 
al may be more interesting to the subject matter specialist, even 
though it may be of little or no interest to a layman who does not un- 
derstand or use the technical terminology. 

If You Wuni More Details on Headability Measurement 

The Air Force Human Resources Laboratory is presently 
publishing a complete review, description, and analysis of the older 
methods for testing the readability/ comprehensibility of text. The 
report titled Read abi nty of textual material: A survey of 
the I iterature will soon become available. You should find this 
ivport to bo of Inti'POHt if you wish to test the readability of your 
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writing. Finally, there are a number of technical and procedural 
matters involved in using these techniques. An expert In the field 
should be ctonsulted before attempting to use them* Here is a list 
of selected readings on readability which you might wish to consult: 

Application of Stmotuve-^of^Intelleot arui psycho^ 
linguistic concepts to reading conipvchensihility 
measurement. A.I. SiegeX and J.R. Burkett (Eds.)> 
in press. 

The effects of reading difficulty^ literacy levels 
and method of presentation on comprehension of 
training materials. M.R. Lautman, A.I» Siegel, A.R. 
Williams, and J. P. Burkett, Air Force Human Resources 
Laboratory, Technical Report, Lowry Air Force Base, 
Colorado, in press. 

Increasing and evaluating the readability of Air Force 
written materials. A.I. Siege 1, P.J. Federman, and 
J.R. Burkett, in press. 

All of these reports were written for the Technical Training 
Division, Air Force Human Resources Laboratory, Air Force Sys- 
tems Command, Lowry AFB, Colorado. Additionally, the following 
two reports might be of interest: 

Normative development for submarine sonar manuals. 
P.J. Federman, D.H. Macpherson, and A.I. Siege 1, Pre- 
pared by Applied Psychological Services, Inc., Wayne, 
Pa., for the Sonar Technology Division, Naval Ship 
Systems Command, Department of the Navy, Engineering 
and Psychology Branch, Psychological Science Division, 
Office of Naval Research, 1970, under Contract N00014- 
67-C-0450. 

IhrD techniques for measuring -^.nd improving reading 
.jorKvre hens ion. R.P. Carver, Washington: American 
Institute for Research, 1973. 
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